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Abstract. Random boolean cellular automata are investigated, where each 
gate has two randomly chosen inputs and is randomly assigned a boolean func- 
tion of its inputs. The effect of non-uniform distributions on the choice of the 
boolean functions is considered. The main results are that if the gates are more 
likely to be assigned constant functions than non-canalyzing functions, then 
with very high probability, the automaton will exhibit very stable behavior: 
most of the gates will stabilize, and the state cyles will be bounded in size. 

1. Introduction 

Boolean cellular automata are models of parallel computation that have attracted 
much attention from researchers in complex systems and artificial life. Computer 
simulation of these automata have shown that they often exhibit stable and robust 
behavior, even when randomly constructed. The implications of this evidence have 
been described in numerous articles by S. Kauffman and others (see for example |Q, 
which includes an extensive bibliography). Only recently, however, have rigorous 
mathematical methods been applied to the study of boolean cellular automata. 
This article is a continuation of the efforts begun in Luczak and Cohen || and 
Lynch ^ . We investigate randomly constructed boolean cellular automata, where 
each gate has two inputs, as in most of Kauffman's simulations. However, instead of 
randomly assigning one of the 16 boolean functions of two arguments to each gate 
with equal probability, we consider the effect of non-uniform distributions, using 
a classification of boolean functions introduced by Kauffman (op. cit.). (We still 
require some mild symmetry conditions on the probabilities.) 

The boolean functions can be partitioned into the canalyzing and noncanalyzing 
functions. A formal definition will be given in the next section, but for now it 
suffices to note that among the canalyzing functions are the constant functions; i.e. 
the function that outputs regardless of its inputs and its negation that always 
outputs 1. Further, among the two-argument boolean functions, there are only two 
non-canalyzing functions: the equivalence function that outputs 1 if and only if 
both of its inputs have the same value, and its negation the EXCLUSIVE OR. 

Our main result is that if the function assigned to each gate is more likely to be 
constant than non-canalyzing, then with very high probability the automaton will 
exhibit very stable behavior. Specifically, it will have these four properties: 

1. Almost all of the gates in the automaton will stabilize, regardless of the start- 
ing state. That is, they eventually settle into a state (0 or 1) that never 
changes. 
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2. Almost all of the gates are weak, that is, changing their state does not affect 
the state cycle that is entered. 

3. From any starting state, the state cycle will be entered quickly. 

4. The state cycles are bounded in size. 

This shows, perhaps surprisingly, that the nonconstant canalyzing functions, which 
include the OR and the AND functions, have a neutral effect on the stability of the 
automaton, ft is the non-canalyzing gates that seem to be the sources of instability. 

Our results, and the earlier results in H and support the belief that stability 
and emergent order are widespread phenomena in boolean cellular automata. In 
addition, they give a simple, exact condition that implies stability. Further, the 
distributions where the probabilities of constant and non-canalyzing gates are equal 
(as in Kauffman's model) appear to be thresholds between very stable and more 
complex behavior. This will be described in a future article. At present, it is known 
to the author that when the two probabilities are equal, with high probability 
almost all of the gates still stabilize and are weak, but the state cycles are no 
longer bounded in size. Most of them are larger than n c for some c > 0. Very 
little is known about the behavior of random automata when the probability of 
non-canalyzing gates exceeds that of constant gates. 

2. Definitions 

We will now give precise definitions of the notions that were alluded to in the 
previous section. Let n be a natural number. A boolean cellular automaton with 
n gates consists of a directed graph D with vertices 1, . . . , n (referred to as gates) 
and a sequence / = {f\ 1 . . . , /„) of boolean functions. In this article, each gate will 
have indegree two, and each boolean function will have two arguments. We say that 
gate j is an input to gate i if (j, i) is an edge of D. A boolean cellular automaton 
B = (D,f) defines a map from {0,1}" (the set of 0-1 sequences of length n) to 
{0, 1}™ in the following way. For each i = 1, . . . , n let ji < ki be the inputs of i. 
Given x = (xx,...,x n ) G {0,1}", B(x) = (f 1 (x jl ,x kl ),...J n (x jn ,x kn )). B may 
be regarded as a finite state automaton with state set {0, l} n and initial state x. 
That is, its state at time is x, and if its state at time Ms y £ {0, 1}™ then its state 
at time t + 1 is B(y). Our first set of definitions pertains to the aspects of stability 
that will be studied. 

Definitions 2.1. Let B be a boolean cellular automaton and x £ {0, 1}™. 

1. We put B t (x) for the state of B at time t, and /*(x) for the value of its ith 
component, or gate, at time t. 

2. Since the number of states is finite, i.e. 2™, there exist times to < t\ such 
that B to (x) — B tl (x). Let t\ be the first time at which this occurs. Then 
B t+tl - to (x) = B l for all t > t Q . We refer to the set of states {B\x) : t > t } 
as the state cycle of x in (_D, /), to distinguish it from a cycle of D in the 
graph-theoretic sense. 

3. The tail of x in (D, f) is {B\x) : t < t }. 

4. Gate i stabilizes in t steps on input x if for all t' > t, f\ (x) = ff{x). 

5. Gate i is weak if for any input x, letting x 1 be identical to x except that its 
ith component is 1 — Xi, 

3t 3oWt(t > t =► B\x) = B^ix 1 )). 

That is, changing the state of i does not affect the state cycle that is entered. 
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While we are primarily interested in stability, the related notion of forcing seems 
to be easier to deal with combinatorially. Thus most of our results pertain to forcing 
in boolean cellular automata, but as will be evident, they translate directly into 
results about stability. 

Definitions 2.2. Let f(x\,X2) be a boolean function of two arguments. 

1. We say that / depends on argument x\ if for some v G {0, 1}, /(0, v) ^ /(l, v). 
A symmetric definition applies when / depends on X2- Similarly, if (D,f) is 
a boolean cellular automaton, fi = /, and the inputs of gate i are jn and fii-, 
then for m — 1,2, i depends on ji m if / depends on x m . 

2. The function / is said to be canalyzing if there is some m = 1 or 2 and 
some values u,v € {0,1} such that for all Xi,X2 € {0,1}, if x m = u then 
f{x\,X2) — v. Argument x m of / is said to be a forcing argument with 
forcing value u and forced value v. Likewise, if (D, f) is a boolean cellular 
automaton and fi is a canalyzing function with forcing argument x m , forcing 
value u and forced value v, then input jim is a forcing input of gate i. That 
is, if the value of ji m is u at time t, then the value of i is guaranteed to be v 
at time i + 1. 

All of these definitions generalize immediately to boolean functions of arbitrar- 
ily many arguments. In the case of two argument boolean functions, the only 
non-canalyzing functions are EQUIVALENCE and exclusive OR. The two constant 
functions f(x,y) = and f(x,y) = 1 are trivially canalyzing, as are the four 
functions that depend on only one argument: 

f(x,y) = x, 
f(x,y) = ~>x, 
f{x,y) = y, and 
f(x,y) = x. 

The remaining eight boolean functions of two arguments are canalyzing, and they 
are all similar in the sense that both arguments are forcing with a single value, and 
there is one forced value. A typical example is the OR function. Both arguments 
are forcing with 1, and the forced value is 1. 

Definition 2.3. Again, (D, f) is a boolean cellular automaton. Using induction 
on t, we define what it means for gate i to be forced to a value v in t steps. 

If fi is the constant function f(x\, x^) — v, then i is forced to v in t steps for all 
t > 0. 

If the inputs jn and ja of i are forced to u\ and 1*2 respectively in t steps, then 
i is forced to fi{u\, U2) in < + 1 steps. 

If fi is a canalyzing function with forcing argument x m , forcing value u, and 
forced value v, and ji m is forced to u in t steps, then i is forced to v in t + 1 steps. 

By induction on t it can be seen that if i is forced in t steps, then it stabilizes 
for all initial states x in t steps. 

The following combinatorial notions will be used in characterizing forcing struc- 
tures. We assume the reader is familiar with the basic concepts of graph theory 
(see e.g. Harary Unless otherwise stated, path and cycle shall mean directed 
path and cycle in the digraph D. 
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Definitions 2.4. 1. For any gate i in (D,f) with inputs jn and let 

Nq(i) = {i} and 
Nj +1 (i) = N-[(j il )UN;(j i2 ). 

2. Then 

c<d 

That is, S~[(i) is the set of all gates that are connected to i by a path of 
length at most d. 

3. In a similar way we define N^(i) and Sj(i), the set of all gates reachable 
from i by paths of length at most d. 

4. For any nonnegative integer d, a d-unforced path is a sequence of distinct gates 
P = (ii, . . . , i p ) such that i r+ i depends on i r for 1 < r < p and none of the 
gates are forced in d steps. 

5. A d-unforced cycle is the same except i\ = i p . 

Note that whether i is forced in d steps is completely determined by the restric- 
tion of D and / to S~[(i). 

We will examine the asymptotic behavior of random boolean cellular automata. 
For each boolean function / of two arguments, we associate a probability a/ G [0, 1], 
where X)/ a / = 1- The random boolean cellular automaton with n gates is the 
result of two random processes. First, a random digraph where every gate has 
indegree two is generated. Independently for each gate, its two inputs are selected 
from the (5) equally likely possibilities. Next, each gate is independently assigned 
a boolean function of two arguments, using the probability distribution (a/ : / : 
{0, l} 2 — > {0,1}}. We will use B = (D,f) to denote a random boolean cellular 
automaton generated as above. For any properties V and Q pertaining to boolean 
cellular automata, we put pr(V,n) for the probability that the random boolean 
cellular automaton on n gates has property V and pr(P\Q,n) for the conditional 
probability that V holds, given that Q holds. Usually, we will omit the n in these 
expressions since it will be understood. 

We classify the two argument boolean functions as follows: 

1. A contains the two constant functions. 

2. £>! contains the four canalyzing functions that depend on one argument. 

3. £>2 contains the eight canalyzing functions that depend on both arguments. 

4. C contains the two non-canalyzing functions. 

Then the probabilities that a gate is assigned a function in each of the categories 
are: 

= S a f 

feA 

fe 2 = a f 

feB 2 
fee 
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Lastly, we put B = B\ U B2 and b = bi + 62, the probability that a gate is assigned 
a nonconstant canalyzing function. Throughout the rest of the article, we assume 
the following symmetry conditions on our distributions: 

a,f = a-,f for all / € A U B2, 

a>f(x, y ) = af(y,x) f° r all f € B%. 

Also, log shall always mean log 2 . 

3. Stable Gates 

As previously mentioned, a gate is stable if it is forced. Thus, a lower bound on 
the probability that a gate is forced also holds for the probability of stability. 

Lemma 3.1. For d > and v = 0, 1 let 

Pd{v) — pr(gate i is forced to v in d steps 

\S7(i) induces an acyclic subgraph of D) and 
Pd =Pd(0) +Pd(l)- 

Then 

Pd (0)= Pd (l) (3.2) 
and P d satisfies the following recurrence: 

Po = a, 
Pd+i = a + bp d + cp\. 



Proof. We prove Equation ( |3.2| ) by induction on d. The recurrence relation will be 
a byproduct. For d = 0, it is clear since Po(0) = Po(l) = a /2- 



Next we prove Equation (3.2) for d + 1, assuming it is true for d. Let j and k 
be the two inputs of i. Since Sj +1 (i) induces an acyclic subgraph, so do Sj(j) and 
S~[(k). The possible ways that i can be forced to v are: 

1. It is assigned the constant function f(x,y) = v. 

2. It is assigned some function / G £>i, and the input on which i depends is 
forced in d steps to the value that forces / to v. 

3. It is assigned some function / 6 B2, v is the forced value of / and at least 
one of its inputs is forced in d steps to the value that forces / to v, or v is 
not the forced value of / but j and k are forced to values u and uu such that 
f(u,w) = v. 

4. It is assigned some function / £ C, and j and k are forced to values u and w 
such that f(u, w) = v. 

We will derive expressions for the probability of each of the four cases, and show 
they are the same for v ~ and 1. The probability of Case (1) is a/2. 

If / € Si, say f(x, y) — x, the probability that i is forced to v in d + 1 steps is 
Pd{v). The other choices for / € B\ are symmetric, and by the induction assumption 
the probability of Case (2) is bipd{0). 

In Case (3), it can be observed that the eight functions in B2 may be partitioned 
into four pairs, each of the form {/, -1/}. Take a typical / £ B2, say the OR function. 
Then is not the forced value of /, but it is for -1/. The probability that / is forced 
to is 

Pd(0) 2 , 
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and the probability that ->f is forced to is 

(1 -p d (l))p d (l)+p d (l)(l-p d (l)) + Pd (lf. 

Summing these two probabilities and using symmetry and the induction hypothesis, 
we get the probability that the function assigned to i is / or -if and i is forced to 
in d + 1 steps: 

a/ xp d {0) 2 + a-, f x (2p d (l) - p d {lf) = (a/+a-,/) x p d (0). 

Summing over all four pairs of functions, the probability of Case (3) is b2 Pd (0). The 
argument when v = 1 is symmetric. 

Lastly, let / G C, say / is exclusive OR. The probability that i is forced to 
in d + 1 steps is p d (0) 2 + p d (l) 2 , and the probability that i is forced to 1 in d+ 1 
steps is 2p d (0)p d (l). By the induction assumption, these probabilities are equal. 
Similar reasoning applies when / is equivalence. Thus the probability of Case 
(4) is 2cp d (Q) 2 regardless of whether v is or 1. 

We have shown that for v = or 1, 

Pd+i(v) = ^ + b Pd (0) + 2c Pd {0) 2 , 

proving Equation (|]^). Furthermore 

p d+ l = a + bp d + cp 2 d . □ 

Corollary 3.3. We have p d > 1 - (1 - a+ c) d+1 . 
Proof. Let q d — 1 — p d . By the Lemma, 

qa = I — a < 1 — a + c and 
1 - 1d+l = a + 6(1 - q d ) + c(l - q d ) 2 . 

Since a + b + c = 1, 

qd+l = (1 - a + c)q d - cqj 
< (1 - a + c)q d 

and the result follows by induction on d. □ 

Theorem 3.4. Let a > c. For any positive a < 1/2 there is a constant > such 
that 

lim pr(B has at least n(l — n~^) gates that stabilize in alogn steps) = 1. 

n — >oo 

Proof. We use the following slight modification of a Fact from B . 
Fact . For any positive a and function u)(n) that increases to infinity, 

lim pr(B has at most u>(n)n 2a gates belonging to cycles of length < alogrt) = 1. 

n — >oo 

Let Y be the random variable that counts the number of gates in B that do not 
belong to a cycle of length < a log n and do not stabilize in a log n steps. Let E(Y) 



be its expectation. By Corollary 3.3, 



E(Y) <n(l-a + c) Qlog " 

= n 1 ^ 1 for some 7 > 0. 
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By Markov's inequality, 

pr(Y > n 1 ^' 2 ) < n-~<' 2 

— > as n — > oo. 

This implies, together with the Fact, that with probability asymptotic to 1, there 
are at most 

n 1 ^' 2 + u{n)n 2a 

gates that do not stabilize in alogn steps, for any function u> that increases to 
infinity. Taking (3 — min(7/2, 1 — 2a) and u = log, the Theorem follows. □ 

4. Unstable Structures 

We now study the sizes and shapes of the unstable components of B. Actually, 
we will be looking at unforced components. Since a collection of gates is unforced if 
it is unstable, showing that the unforced structures have certain restrictions implies 
the same for unstable structures. The next lemma is central to all these results. 

Lemma 4.1. For any nonnegative integers d and I such that I < (logn) 2 , 

pr(£> has a d-unforced path of length I) < n[2(l — a + c) d + b + 2c + o(l)} 1 . 

Proof. We select a chain of I + 1 gates as follows. Begin with ii+i. Then select 
the two element set of inputs to From Ii+i, select the gate which is the 
predecessor of in the chain, and call it i\. Call the other gate ji. Repeat this 
selection process with ii, and so on, ending with i\ and j\. The number of possible 
sequences . . . , ii+i) and (ji, . . . , ji) that can be selected this way is bounded by 

nx [(?) x 2] 1 . 

Also, 

i 

pr(/\((v,v +1 ) e D A ED)) = ( n 2 )- 1 . 

r=l 

For r = 0, . . . , I + 1 let V r be the event that (ii, . . . , i r ) is a d-unforced path. Wc 
will finish the proof by showing that 

w{V r ) < [(1 - a + b) d + (b + 2c) /2 + o(l)f. 
This will follow from 

w{V r \P r -i) < (1 - a + b) d + (b + 2c)/2 + o(l). 
To prove this, let Q r be the event that N^_ 1 (j r ) docs not induce a tree and 
N d-itir) n [f a Z[ N~[(i a ) = 0. First, we show that 

pr(-.fir) = o(l). (4.2) 

Now Q r fails only if there exists a path P of length p < d beginning at some 
gate k and ending at i r and another path Q of length q, 1 < q < d, beginning at 
k, disjoint from P except at k and possibly its other endpoint, which must be in P 
or {ii, . . . , i r }. There are no more than n p ways of choosing P and no more than 
n 9_1 x (p + r) ways of choosing Q. The probability of any such choice is bounded 
above by {2/n) p+q . Therefore the probability that P and Q exist is bounded above 

by 

d d 

E 2P+q (P + r ) n ^ = O((logn) 2 n- 1 ), 

p=0 q=l 
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proving Equation (fh2|). 

Now we examine the conditional probability of V r , given that V r -\ A Q r . One 
possibility is that j r -i is not forced in d — 1 steps. Since Q r holds, this event is 



independent of V r —u an d by Corollary 3.3 this has probability < (1 — a + c) . The 



other possibility is that j r -i is forced in d — 1 steps, but i r is not forced in d steps. 
There are three cases to consider: 

1. fir e B 1 

2. fir e B 2 

3. fir G C 

In Case (1), the input on which i r depends must be i r -i and not j r -i- Given that 
fi r 6 Bi, the probability that i r depends on i r -\ is 1/2 because of the symmetry 
condition a,f( x ,y) = a f(y,x)- Thus the probability of Case (1) is bi/2. 

In Case (2), fi r can be forced by a single value on cither input. Since j r -i is 
forced, it must be forced to the value v that does not force fi r . Given that j r -i 



is forced, by Lemma 3.1, the conditional probability that it is forced to v is 1/2. 



Therefore the probability of Case (2) is 62/2. 
The probability of Case (3) is c. Altogether, 

pr(V r \V r -l) < whQr) + (1 - a + c) d + h - + c, 
and the Lemma follows. □ 

Lemma 4.3. For any nonnegative integers d and I such that I < (logn) 2 , 

pr(J3 has a d-unforced cycle of length I) < [2(1 — a + c) d + b + 2c + o(l)]'. 



Proof. The same proof as in Lemma 4.1 applies, except the factor n disappears 



because i\ — ii+i- □ 

Lemma 4.4. For any nonnegative integers d and I such that I < (logn) 2 , for any 
gate i in B, 

pr(£? has a d-unforced path of length I beginning at i) 

< [2(1 -a + c) d + b + 2c + o(l)} 1 . 
Proof. The same proof applies here because i\ = i is already chosen. □ 

Theorem 4.5. If a > c then there exists a > such that 

lim pr(i? has at least n(l — nr a ) weak gates ) = 1. 

n — >oo 

Proof. Choose d so that 2(1 — a + c) d + b + 2c < 1. This is possible because a > c 
and a + b + c = 1. Take I = logn/3 and let Y be the random variable that counts 
the number of gates in B that do not belong to a cycle of length < I and are not 
weak. Consider any such gate i. If all d-unforced chains starting at i are of length 
< I, then the gates in N, ■ (i) are not affected by the state of i. Thus the state of i 
does not affect the state cycle that B enters, and i would be weak. Therefore there 



must be a ci-unforced path beginning at i of length I. By Lemma 1.4 

E(Y) < rc 1-7 for some 7 > 0. 



The rest of the proof proceeds as in the proof of Theorem 3.4. □ 
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Lemma 4.6. Let a > c. For sufficiently large d there exists a constant (3 such that 
lim pr(_B has a d-unforced path of length /31ogn) = 0. 

n — >oo 

Proof. Since a > c and a + b + c = 1, for sufficiently large d and n, there is a < 1 
such that 

2(1 - a + c) d + b + 2c + o(l) < a. 



Then for any (3 > 0, c^ log " = r^ lo s Q , and by Lemma 4.1, the result follows. □ 



Lemma 4.7. Let a > c. For sufficiently large d and every e > 0, there is k such 
that 

pr(B has a d-unforced cycle of length > k) < e. 
Proof. Take a and /3 as in the last Lemma. Then 
pr(B has a d-unforced cycle of length > /31ogn) 

< pr(£? has a <i-unforced path of length f3\ogn) 
= o(l). 



For any I < /31ogn, by Lemma 4.3, 



pr(B has a d-unforced cycle of length /) < a 1 and 

log ra 

pr(£? has a d-unforced cycle of length > k) < a 1 + o(l) 

;=fe 

< z +0(1 

1 — a 

< e 

if k > log((l - a)e)/loga. □ 

Lemma 4.8. Let a > c. For sufficiently large d 

lim pr(I? has d-unforced cycles connected by a d-unforced path ) = 0. 



Proof. Let e > 0. By Lemmas 4.6 and 4.7, with probability greater than 1 — e/2, we 



can assume there are no d-unforced cycles larger than k and no d-unforced paths 



longer than fjlogn. Let k\,k^ < k and I < fjlogn. Taking a as in Lemma 4.6 
and using the same argument, the probability that there exist d-unforced cycles of 
length k\ and k 2 connected by a path of length I is bounded above by 2n~ 1 a kl+k2+l . 
Summing over all ki,k 2 < k and I < [3\ogn, the probability that there exist d- 
unforced cycles connected by a d-unforced path is e/2 + o(l). □ 

Theorem 4.9. If a > c then there is a constant (3 such that 

lim pr(i? has a tail longer than (3\ogn) = 0. 



Proof. We take d as first used in Lemma 4.6 . After d steps, the only gates that are 



not yet stable are those in d-unforced paths and cycles. We may assume that all 
these cycles and paths are disjoint except possibly at the endpoints of the paths. 



By Lemma 4.8, with probability 1 — o(l), no path begins and ends at a cycle. 
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Let I be the length of the longest cZ-unforced path in (D, f) and m be the size 
of its largest d-unforced cycle. After I more steps, the only gates that are not yet 
stable are those in (i-unforced cycles and paths beginning at an unforced cycle. 

Now consider the state of the gates in these cycles, i.e. the projection of the state 
of (D, /}, where we look only at the values of the gates in the d- unforced cycles. 
This state will reach its state cycle in at most 2m steps. Then (D, /) will reach 
its state cycle in at most I more steps. The Theorem then follows from Lemma 



4.6. □ 



Theorem 4.10. If a > c then for every e > there is s such that 

pr(B has a state cycle larger than s) < e. 
Proof. Any path (or cycle) of unstable gates is also a d- unforced path (or cycle). By 



Lemma 4.8, no (i-unforced cycle is connected by a ci-unforced path to a d-unforced 
cycle. Therefore no cycle of unstable gates is connected by a path of unstable gates 
to a cycle of unstable gates. In other words, the unstable gates are partitioned 
into disjoint sets, each set inducing a subgraph of D with one cycle and possibly 
some paths that begin on the cycle but are pairwise disjoint off the cycle. Take 
any input x, and consider the restriction x of x to the gates in any one of these 
partitions. Let m be the size of the cycle induced by this partition. The state 



cycle entered by x has size t or 2t for some factor t of m. By Lemma 4.7, with 
probability 1 — e/2, rn < k. The size of the state cycle entered by x is the least 
common multiple of the sizes of the state cycles of the partitions. This is bounded 
above by s — 21cm(l, . . . , k — 1). □ 

Corollary 4.11. Let a > c and Lo(n) be any unbounded increasing function. Then 
lim pr(£> has a state cycle larger than ui(n)) = 0. 

n — >oo 
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